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Abstract 

It has been recently proposed that neutrino mass could originate from Yukawa interactions 
of leptons with new colored particles. This raises the interesting possibility of testing mass gen- 
eration through copious production of those particles at hadron colliders. A realistic assessment 
of it however should take into account how large those interactions could be from available 
precision results. In this work we make a systematic analysis to the flavor structure in Yukawa 
couplings, provide a convenient parametrization to it, and investigate the rare radiative and pure 
leptonic decays of the muon and tau leptons. For general values of parameters the muon de- 
cays set stringent constraints on the couplings, and all rare tau decays are far below the current 
experimental sensitivity. However, there is room in parameter space in which the muon decays 
could be significantly suppressed by destructive interference between colored particles without 
generically reducing the couplings themselves. This is also the region of parameters that is 
relevant to collider physics. We show that for this part of parameter space some tau decays can 
reach or are close to the current level of precision. 
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1 Introduction 



It has been verified by oscillation and other low energy experiments that neutrinos have tiny and 
non-degenerate masses, yet the mechanism for mass generation has remained mysterious. It is 
generally believed that the new physics relevant to the tiny mass lies beyond the standard model 
(SM) and its effects may be systematically accounted for by high dimensional operators. Indeed, 
viewing SM as an effective field theory at low energies one can write down a unique dimension 
five operator in terms of the Higgs and lepton doublet fields that generates the neutrino mass 
upon spontaneous breaking of electroweak symmetries 0]|. It is interesting that there are only 
three realizations of the operator at tree level which correspond exactly to the three types 
of seesaw models |[3l|4l[5]|. In each case, a single representation under the SM gauge group, 
SU (3)c x SU(2)l x U( 1 )y, is prescribed for the new fields to link the Higgs and lepton doublets. 

In the above seesaw models, the tininess of the neutrino mass is attributed to a huge scale of 
new physics or feeble interactions that induce the operator. In either case it would be difficult 
to detect low energy effects of new physics beyond neutrino mass. One way to relieve the 
tension is to consider certain radiative origin of neutrino mass [6]. By prescribing two or more 
types of representations but excluding those utilized in the three seesaw models, it is possible to 
generate tiny neutrino mass without requiring all couplings to be dimini shingly small or all new 
particles to be inaccessibly heavy. This is even so when the mass originates from a two-loop 
dUl or three-loop effect [9 ]. These radiative mechanisms usually employ small representations 
of the electroweak group. The other way to generate neutrino mass without sacrificing too 
much in couplings or heavy masses has been suggested recently [[Toll . By assigning larger 
representations, it is possible to forbid the dimension five operator at tree level so that the 
operator relevant for neutrino mass first appears at dimension seven. 

In all of the above mechanisms it has been tacitly assumed that the particles responsible for 
neutrino mass generation do not participate strong interactions. But this could well be an easy 
prejudice as there is no experimental hint for it at all. The idea that neutrino mass may originate 
from interactions with colored particles becomes especially relevant now. These particles if not 
very heavy can be copiously produced at the LHC so that the origin of neutrino mass could po- 
tentially be tested there. A concrete model in this spirit has been recently proposed by Fileviez 
Perez and Wise 0T]|. Since the colored fields must appear in pair in interactions responsible 
for neutrino mass, the minimal choice includes both scalar and fermionic degrees of freedom. 
To avoid chiral anomaly from the new fermions, they considered the simplest option that the 
fermions belong to the adjoint representation of SU (3)c and are neutral under U(l)y- This in 
turn singles out naturally the octet scalars that were previously introduced in the quark sector 
|fT2"l[T3l in the framework of minimal flavor violation [14]. The potential relevance of the model 
to leptogenesis has been discussed in Ref. lfT5i 

The interactions that generate neutrino mass and mixing generically mediate lepton flavor 
violating (LFV) transitions and anomalous magnetic moments of charged leptons. While the 
measurements in the e\x sector have reached an impressive level of precision lTl6lfT7l[T8l[T9ll . the 
upper bounds on LFV decays of the tau lepton are improving rapidly at the B factories, see Refs. 
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Il20l |2TI l22l l23l for the precision frontier. And even more stringent limits on some of them are 
expected in the near future. These constraints from low energy processes will significantly affect 
the feasibility of testing neutrino mass mechanisms at colliders. The purpose of the current work 
is to investigate systematically those processes in the color octet model suggested in Ref. ifTTI . 
and to see if there is any room in the parameter space that could be relevant to collider physics. 
The LFV decays have been extensively studied in various models of neutrino mass and mixing. 
As a few examples, we mention Refs. j|24l| in supersymmetric models, Il25ll26ll27l in seesaw 
models, ll28l in a model of mirror fermions ll29l . and in ll30ll in a little Higgs model. We refer 
to the reviews OTI for a more complete list of references. 

The paper is organized as follows. In the next section we introduce the octet model and 
provide a convenient parametrization to the Yukawa couplings. The radiative and pure leptonic 
transitions are calculated analytically in section [3l and the parameter space is then discussed in 
section HI We summarize our main results in the last section. Some phase space integrals are 
evaluated in Appendix A. 

2 Parametrization of couplings in octet model 

As we briefly reviewed in section [H the octet model ifTTTl introduces the color-octet scalars and 
fermions on top of the SM Higgs field H and lepton fields, Ll«, £n a , where L(R), a refer 
to chirality and flavor respectively. The octet scalars, S ar , have the same quantum numbers 
under SU (2)l X U(l)y as H. Here a is the color index and r enumerates the scalars. The octet 
fermions are neutral under U( l)y but may be a singlet or triplet of SU (2)y, which we denote as 
the two cases: 

case A: p aXl 

caseB: Z-=f^ _i y ) . (0 

V /tax ^2 ^ ax J 

where x enumerates the fermions. We assume arbitrarily p and % are right-handed. While p 
and x° are Majorana fields, x ± being real under SU (3)c will be paired into a Dirac field. The 
Yukawa couplings of leptons in SM and the additional terms in the octet model are 

y a pLLaH£ R p +h.c, 

+ h.c, (2) 

Zax^LaXaxSar + h.C. , 

where S ar = iXiS^ and summation over repeated indices is implied. 

The charged leptons become massive when H develops a vacuum expectation value, v/V2. 
Since neutrinos are massless at tree level, the diagonalizing matrices for I can be absorbed by 
redefinition of the fields. We assume this has been done already. For generally non-degenerate 
scalars or fermions there is no symmetry mixing them. Since the octet fermions are neutral 
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Figure 1: Diagrams for neutrino masses. 

under U(l)y and either an adjoint or a singlet of SU (2) L , rephasing is not possible for them. 
For the scalars, we assume their phase convention has been fixed in the potential lfT2ll . Thus 
what we can do at most is to rephase the fields it (and £r identically), leaving the remaining 
magnitudes and phases in z being physical parameters. 

The neutrinos may gain mass from radiative corrections. Since there are no further degrees 
of freedom for them to pair with, the mass must necessarily be of Majorana nature. For this to 
be possible, the lepton number conservation has to be violated. This happens when the Yukawa 
couplings are augmented by the following term in the potential with a single octet scalar lfT2l : 

_ VD Ax(slH) 2 + h.c, (3) 

where A is real by convention. It turns out that for two out of the three neutrinos to become 
massive, the minimal choice is to have either one octet scalar plus two octet fermions or the 
other way around [fTT]] . To avoid the complicated mixing amongst scalars, we shall stick here to 
the former choice. We shall drop from now on the index r while x assumes values 1, 2. In this 
minimal scenario, the z couplings contain nine physical parameters, i.e., six magnitudes plus 
three phases, and will be parameterized later in this section. 

The neutrino mass matrix may be obtained by first computing the dimension five operator, 
~VpPLV a H°H , depicted in Fig. 1(a), where the virtual fermion can be p x (case A) or Xx (case 
B). The result is ifTTIl . 

2 
x=l 

where 

„ _ ^ Ay2m * l+^(lnr x -l) _m| 

Here C = N% - 1 = 8 is a color factor, and % = 1 (1/2) in case A ( B). We have denoted 
the masses of S° and p x (Xx) by mo and m x respectively. Since the mass splitting between 
the neutral and charged octet particles arises at a higher order, we shall ignore it and use the 
same notation for S ± (and xf m ca se B). The mass matrix can also be obtained by calculating 
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the self-energy of neutrinos at zero momentum shown in Fig. 1(b), where the decomposition 
S% = (R a + il a ) I \fl has been made. The result is to replace the above \i x by the following one: 



2 2 2 

9 9 ffl-Y ? 9 -i 9 9 /72 p 

m^m^ In — ^ — m/m^ In — | + m^mj In — ^ 



mj^ 



(6) 



327T 2 (m 2 — m|) (m 2 — m 2 

where m#./ are the masses of i?, /, whose splitting is measured by the A term in the potential, 

m|-m 2 = Av 2 . (7) 

The result in eq © is an approximation to eq © in the limit of small mass splitting, |Av 2 | <C 
(m| + mj) /2. Since A is a measure of lepton number violation, it should be naturally small. We 
shall work in this limit below. 

With two octet fermions the matrix M v is degenerate and has a zero eigenvalue. This arises 
because it is a product of a matrix of lower rank with its transpose. Noting \x x jX > for 
arbitrary masses, we can express it as M v = ZZ T , where Z = (u*,^) is a 3 x 2 matrix in terms 
of the column vectors, u x = ^J\T x Zax (not summed over x) for A > 0, or u x = \J—\i x {iz a x) for 
A < 0. The factors of i in the latter case will not affect our later results which involve z always 
in the form of z* ax zp x , and can thus be ignored. This implies that we can restrict ourselves in 
phenomenological analysis to A > without loss of generality. Diagonalization by the leptonic 
mixing matrix t/pMNS yields two possible spectra of normal or inverted hierarchy: 

NH: m Vl = 0, m V2 = A_, m V3 = A+, 

IH: m Vj = 0, m Vl = A_, m V2 = A + , (8) 

where A+ > A- > are the two non-zero eigenvalues. For both hierarchies, we have £/pmns = 
U^Ey, where is the analog of the CKM matrix with three angles ($12, 023 , $13) an d a Dirac 
CP phase 8, and E v = diag(l,e !0! , 1) contains a single Majorana phase. We write in terms of 
the column vectors: 

C/PMNS = (xi,X 2 ,X 3 ), (9) 

with xjxj = 8jj. It can be readily verified that the zero eigenvalue requires the corresponding 
row (first for NH or third for IH) of Up MNS Z to vanish. This means that Z can be generally 
parameterized in terms of the other two column vectors in £/pmns : 

NH: Ui = C-X2 + C+X3, U2 = ^-X2 + 6?+X3, 

IH: ui = C-Xi +c + X2, U2 = d-X\ + d + X2. (10) 

The coefficients c±, d± can be determined in terms of the eigenvalues A± and a free complex 
parameter. We find that the following parametrization is convenient and applies to both hierar- 
chies: 

A_- — --tt, d- = \fxl- 



1+t 2 ' v 1+f 2 ' 
c + = VU^d + = y^^L, (11) 
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Figure 2: Diagrams for radiative transitions. 

where t is complex. And the Yukawa couplings now become 

Zax=—?==- (12) 

The physical parameters in z ax have been traded for two neutrino masses X±, three angles Qu, 
one Dirac phase 8, one Majorana phase a, and one complex number t. 

The diagonalization of leptons causes no other changes in gauge interactions but attaching 
^pmns to their charged currents. In particular, the neutral currents of leptons are flavor diagonal. 
We can therefore restrict ourselves to interactions involving octet particles for the effects that 
are suppressed by SM interactions. Introducing the four-component fields, 



V L / V PaR J V %aR J V XaR 

and using fg = g c f c , the Yukawa couplings are modified to (Pr = (1 + 75) /2), 
-if/ uk = vC/; MNS z J P^*-«p fl 5- + h.c, 

= ^fUl MNS zPRxX*-Xa(ul Mm z) T P R yS- 

+IzP R XaS° a * + -^IzPrxX + h-c (14) 
Note in passing that the massless neutrino does not couple to color octet fermions. 

3 Radiative and pure leptonic transitions 



A direct consequence of the interactions shown in eq (1141) is the occurrence of LFV transitions 
of the charged leptons, £ a —> IpY an d ^5 ~ * ^a^p^y, and the contribution to related quantities 
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like the anomalous magnetic moment and the muonium-anti-muonium transition rate. We start 
with the transition £ a (p) — * £p(k) + y-*'(q), which also contributes to the pure leptonic decay 
when the photon converts to a pair of leptons. Our sign convention for the QED coupling is, 

The Feynman diagrams are shown in Fig. 2, where (a)-(c) appear in both cases A and B and 
(d)-(f) occur only for case B. Working to the first nontrivial order in the external momenta, a 
straightforward calculation yields the amplitude: 

"^CT^ = z A»4t{[^i(^)+2(l-5)^W]u(*)ft(^-^H(p) 

+ [$F 2 (r x ) +2(1 - $)G2(r x )}u(k)(m a P R + mpP L )io^ v q v u(p)y (15) 

where summation over x is implied, and the loop functions are 

1 

36(x~ n 4 



Fi(jc) = — [2-9x+18x 2 -llx 3 + 6x 3 lnx] 



F 2 (x) = 1 4 [l-6x + 3x 2 + 2x 3 - 6x 2 lnx] 

J. _ ( X -L ) 



1 



G iW = W77 [-16 + 45x-36x 2 + lx 3 -121nx+18xlnxl , 

36(x — l) 4 

G 2 (» = — r- — -jl-l-lx + bx 2 -x 3 -6xlnx\. (16) 
12(jc— l) 4 

Some comments are in order. That the above Lorentz structures satisfy Ward identity serves as a 
useful check to our calculation. The Fi 2 terms from Figs (2a)-(2c) occur for both cases A and B 
while the G12 terms from Figs (2d)-(2f) appear only in case B. This is controlled by the switch 
parameter £ introduced earlier. Since we have ignored the mass splitting between the neutral 
and charged particles, the loop functions depend only on the mass ratios of the fermions to the 
scalar. While Fi^C*), G\(x) > and G 2 (x) < 0, they all decrease monotonically in magnitude 
as x increases. Since the contributions from the real and imaginary parts of 5° in Figs. (2d)-(2f) 
simply add, when their mass splitting is relevant the exact result can be obtained by averaging 
the shown one over their masses. 

From the above result we obtain the lepton anomalous magnetic moment and the branching 
ratio for the transition t a — > £py. 

a(la) = -4lM 2 [^W + 2(l-^)G2W], (17) 
% m o x= 1 



Br(£ a ^£pr) = Mta^VaipVp 

12a EM 



X 



KG 2 F ml 



Z^4[^2W+2(l-^)G 2 (r, 



= 1 



(18) 



where 0£em is the fine structure constant. We have used T(£ a — > v a £pVp) = G 2 F m 5 a / (192TZ 3 ) 
and neglected the final state masses in phase space integration. The decay /i — ► ey was also 
computed for case A (i.e., t. = 1) in Ref. lfl~5ll. but our result differs from theirs. 
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Figure 3: Additional box diagrams for pure leptonic decays. 

The pure leptonic decay £g(p) — > £a{ki)£p{k 2 )£y{k's) receives a contribution from box di- 
agrams, in addition to the one from the off-shell radiative transition computed above when 
£p = £y or £ a = £y. The box diagrams are shown in Fig. 3, where the arrows indicate the flow 
of negative charge. Fig. 3(a) appears for both cases A and B while Fig. 3(b) and (c) occur only 
for case B. In the approximation of neglecting the external momenta compared with the heavy 
octet masses, Fig. 3(b) and (c) cancel each other, leaving us with the result: 

Ct 2 

Fig. 3 = ' ZaxZ^ZpyZyyUik^PLUip) U (k 2 ) fP L V{k 3 )H{r X , Ty) , (19) 



where summations over x and y are implied, and the loop function is 



H(x,y) 



4(x-y) 



1 xlnx xlnx 1 ylny ylny 

i 7~. To ~, I - 



l-x l-x (l-x) 2 l-y l-y (1-yY 



(20) 



which is symmetric and positive-definite. The result has the correct anti-symmetry under the 
interchanges a <-> /3 and k\ <-> k 2 upon using Fierz identity. 

With three generations of leptons there are three possible flavor configurations for the final 
states from a fixed initial state: 

(1) £ s (p) - £ a (kl)i a (h)£y(k3), £ a + ty, 

(2) l 8 {p)^l a {h)lfi{k 2 )ip{h), £ a ^£p, 

(3) £ s (p) -> £a(h)£a(k 2 )£a(k3). (21) 
We list their decay amplitudes separately. For decay (1), only the box diagram contributes: 

2CB 2 

i£ ^^ = 2 -(I ^ axZs x ZayZyyUiY^P L u(p)u 2 fP L v 3 H(r x , r y ), (22) 

where the factor 2 takes into account the identical particles in the final state upon using Fierz 
identity. For decay (2), both radiative and box diagrams contribute. It is important to make sure 
that their relative sign is correct: 

uzf (2) = + i**b, (23) 
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where upon using equations of motion and Fierz identity and denoting sy = [ki + kj) 2 , 



A 



flrtJi(^i('*)+2(l-§)Gi(r,)) 



+ (m s P R + m a P L ) i0^ v {k 2 + k 3 ) v s 23 l (^F 2 (r x )+2(\-^)G 2 (r x ))ju(p), 
Ct 2 

2- 71 \2 z h z *8x (ZaxZpy + zp x z ay ) «1 V^Mp) u 2 f P L v 3 H(r x , r y ). (24) 
ITIqI y~r7C J 

Finally, the amplitude for decay (3) can be obtained from eq (|24l) by substitutions and anti- 
symmetrization: 

^(3) = ^(2)\ p=a -{ki^k 2 ). (25) 

The branching ratio for the process (1) can be worked out straightforwardly using the phase 
space integral Ij defined and calculated in Appendix A, 



2e4 



Br(l)=Br(£ 5 ^£«v 5 v ce ; 



2 w 7t 4 m 4 Q G 2 



y.ZaxZxrZayZ Vv H(r x , r v ) 



x,y 



(26) 



The decay rate for the process (2) is more complicated, both because it has radiative and box 
contributions and because there is a logarithmic singularity in the mass imp) of leptons con- 
nected to the virtual photon. Care must be exercised in dropping mp in order not to miss terms 
at the considered order. We find it convenient to decompose the amplitude in the form: 



C- l ml(4n) 



where 



B 

T 2 



B + T x - T 2 m 2 5 s- 3 l j U 2 fPmu l y ll P L u{p) 

+ (Yi - T 2 m 2 5 s 23 i y 2 fPRV3Uir^PLu(p) 
+2T 2 m 8 s 2 ]u 2 k'\v 3 u\P R u{p), 



-% 2 Z%Z*Sx {zaxZp y +Zp x Z ay ) H(r x , r y ), 
e 2 ZaxZ% x ^F l {r x ) + 2{\-t ) )G,{r x )), 
e 2 Zaxzl x ^F 2 {r x ) + 2(1 -§)Gfe(r,)). 



(27) 



(28) 



The decay rate is, in terms of the integrals in Appendix A 



m§ C 2 mt 



and the branching ratio is 



\B + 7i| z 4/ 3 + |7i \ Z 4I 3 - Re(BT 2 *)4I 2 - Re(T { T 2 *)4h 
+ \T 2 \ 2 [2J l -SJ 2 + 4K], 



(29) 



Br(2) = Bi(e s ^£ a v s v a ] 



-SRe(T l T 2 *) + 



c 1 



2 n n 4 m 4 G 2 



\B + 7/i | 2 + |7\ | 2 - 4Re(5r 2 *) 



14 mi 
— + 81n^ 9 
3 4m 2 J 



I Til 



(30) 



Although the amplitude for the process (3) contains twice as many terms as for the process 
(2), its decay rate is not much more difficult to calculate. Each of the two terms in eq (1251) when 
squared separately contributes the same to the rate, i.e., same as shown in eq (|29l ) upon setting 
/3 = a and including a factor A for identical particles. Although their interference has both 
and s^ 1 terms, the potential singularities do not overlap in kinematics. We can therefore 
do algebra with m a = without losing singular terms of the form lnm^. Using the symmetry 
of phase space we find all those terms are cancelled in the interference, yielding a regular 
contribution to the rate. The sum is 



T(3) m%(\K) 
m§ C 2 mt 



\B + Tx | 2 8/ 3 + | Ti | 2 4/ 3 - Re(5r 2 *) 8/ 2 - Re^ 7 2 *)4(/ 1 + 1 2 ) 



+ \T 2 \ 



2/ 2 + 2/i-8/ 2 + 4£ 



(3D 



where B, T\, and T 2 are obtained from eq (|28l ) by setting j5 = a. The branching ratio is, 

- - , c 2 



Br(3) 



Br 



tVsVa, 



2 n K 4 m 4 Q G 2 F 



2|5+ri| 2 + |ri| 2 



-8Re(5r 2 *) - 12Re(rir 2 *) + 



\Ti\ 



(32) 



The decay rate for ji — > 3e from similar Lorentz structures was also calculated long ago in Ref 
[|33l . Their result coincides with ours only upon including the K term as shown in eq (|3T| ). This 
term was easily missed since it is apparently of a higher order in m 2 . 

Finally, the process (1) also implies an effective interaction that can induce the muonium- 
anti-muonium oscillation: 



=^eff = -G M]i ffiy a P L e pLY a PLe, 
where the effective Fermi constant is, 



(33) 



'MM 



V2 ~ ml{Anf^ ^z, y zt y H(r x ,r y ). 



(34) 



4 Numerical analysis 

Before we embark on numerical discussion, we make some general remarks on the results 
obtained so far. This will help us identify potentially interesting regions in parameter space. The 
starting point is the induced neutrino masses that set a basic constraint on the free parameters 
in the octet model. Since the neutrinos are extremely much lighter than the octet particles, 
the effects due to Yukawa couplings may be relevant only when the A parameter is tiny. With 
fixed neutrino and octet masses, we have \z\ « (AC)~ 1//2 , where C is the dimension of the 
real representation to which the new colored particles belong. Therefore, a smaller A tends 
to enhance the box diagrams more than the radiative ones, while a larger representation tends 
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to suppress the former while leaving the latter intact. But in practice the box diagrams never 
dominate leptonic transitions for perturbative z parameters when the stringent constraints from 
muon decays are taken into account. As a matter of fact, we find that those constraints are so 
strong that the branching ratios of all rare tau decays are generally much below the level to 
be accessible in the near future even when some z parameters have a magnitude of order one. 
This arises from the fact that the lepton mixing is very close to the tri-bimaximal pattern whose 
entries are either order one or zero. This feature generally carries over to the z parameters 
though the latter involve other parameters. For the tri-bimaximal mixing, we have for NH 



z a\ 



and for IH 



7 tb 




\ 



4- JLpia I JL r 

, Lp' a -i_JL r I 



z a2 



1+f 2 




-¥ a 



f v 



(35) 




( +4= 



i JL r J a v2 

_ JL r P ia 4- 
V v 7 ! V + V3 / 



7 tb 
Za2 



l+r 2 




V 



V3 V + s/3 
2 r Ja n 

"73 rve ~V6 
_|__ ?_ r piaiJL 



(36) 



where r v = a/A+ / A- > 1 by definition and r\ = (1 — t 2 )/t is complex. 

Since the constraints from the decays /! — > ey, 3e make the majority of parameter space 
practically inaccessible, we turn to consider the possibility that the dominant contributions to 
those processes may be cancelled between the two octet fermions. This will then impose a 
relation among various parameters. Since the tri-bimaximal pattern serves as an excellent ap- 
proximation to the mixing matrix and simplifies the analysis considerably, we shall determine 
the regions in parameter space where the cancellation occurs for the pattern. This will be em- 
ployed later as a guide to scan parameters in interesting intervals where some processes might 
be accessible without breaking the stringent bounds on the muon decays. In addition, we find 
that the heavy scalar limit mo ^> m\ % is particularly interesting. In the limit the radiative de- 
cays are independent of the scalar mass while the pure box induced decays are power enhanced. 
This apparently strange behavior is of course due to the fixed neutrino masses. But we should 
also keep in mind that we cannot take the limit literally for numerical analysis since z being 
proportional to mo would exceed the perturbative regime. 

In the heavy octet scalar limit, r x <C 1 , all loop functions are independent of r x except that 
G\{r x ) has a residual \nr x dependence. The suppression of muon decays then simplifies to the 
(fie) cancellation condition: 



tb* _tb , tb* tb 
z \l\ z e\^ z \i2 z e2 



0, 



(37) 



which involves the parameters a, r v , rj, and R = m\/nt2. In case A all leading terms are 
cancelled, while in case B there remain lnr Y terms from Gi which are significant only when 
mi 2 are well separated. Our later numerical discussion will not involve this situation. Eq (1371 
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can be solved exactly. Consider the NH first. The existence of solutions to eq (1371) requires that 



cos(2a) <f(R), f(x) 



1 

2x 



^(i-x 2 ) 2 -(i+x 2 ; 



(38) 



For R g (R ,R 



the above is automatically fulfilled while for R G (R -,R+) it has to be 

2 



checked. Here we have denoted R± 



1+2/(3^) ± v/2/(3r 2 ) , which are roughly 0. 5 1 

and 1.97 using the best-fit values for neutrino masses 041 . Am 2 ol = 7.6 x 10~ 5 eV 2 , |Am 2 tm | = 
2.4 x 10~ 3 eV 2 . Denoting Tj = |rj \e'P, the phase /3 is determined uniquely for given (cc,R) by 



tan/3 



l-R 
l+R 



tana, c\ = V6r v (l 



Rf-^l<0, 



cos a 



(39) 



and the real positive solutions for |t]| are 

\l\± 



1 

2R 



ci± 



16i? 



(40) 



To each 7] correspond two values of t, t± 



- r\ ± a/t] 2 + 4 . There are thus generally four 
solutions to the (/ie) cancellation condition in eq (1371) . which will be named (from |tj|+) 
and ?3,4 (from |tj|_). Note that t\t2 = t^U = — 1. The relation is not accidental but reflects a 
symmetry in our parametrization in eq (ITTT) : when t is replaced by — 1 /t our z only flips its sign. 
The IH case is solved similarly. The existence of solutions to eq (1371) requires that 



cos (2a) < g(R), g(x) 



2\2 



(x 2 + r 



(41) 



Defining R ± =R ± J R 2 - 1 with R = (Ar A v + r 2 + 4)/(9r 2 ) and noting r 2 >R + >R > r~ 2 , 
the requirement is automatically fulfilled for R ^ (R -,R+) while it has to be checked for R G 
(R -,R + ). The latter interval is very narrow in IH since R ~ 0.985 and R + ps 1.015. There are 
generally two solutions to 77 (except at 7? 



r 2 ), 



■ci± 



■4c ], 



(42) 



where 



/3 = arctan 



R- 1 



tana G (-7r/2,7r/2), 



v^r v (l-/?) cos/3 4(r 2 #-l) 



cos a 



(43) 



The solutions for f are also denoted by ?i ,2,3,4 as in NH case. 

We show in Fig. 4 the curves for the cancellation condition in eq (1371) for both NH and 
IH cases. In the upper panels, the real t parameter varies as a function of R at a = 0. All of 
four solutions are shown (t^y upper (lower) solid curve, t^y. upper (lower) dotted). Since 
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Figure 4: Curves for cancellation condition in eq (1371) are shown for both NH and IH cases. 
Upper panels: real t varies as a function of R at a = 0. All four solutions are shown. Lower 
panels: real and imaginary parts of t vary as a changes from to 7t at R = 3. Only two out 
of four solutions are depicted. The starting and ending values of a are indicated. Note the 
discontinuity at a = \%. 



\f(x) | < 1 forjce (R-,R + ) in the NH case, there are no solutions to t when R lies in the interval. 
The situation is similar in the IH case though the interval becomes very narrow due to r v « 1 
and t varies rapidly close to the ends of the interval. When R is removed away from R± ~ 1, 
it is a good approximation to assume r v = 1, in which limit the four solutions become flat in 
R and saturate the values, t — (— 1 ± y/3) / y2, y/2± y/3. In other words, at these values of t 
the cancellation occurs independently of R as long as R is not too close to unity. The lower 
panels show how the complex t varies as the Majorana phase a moves from to % at R = 3. For 
clarity of illustration we only show t\ (solid) and to, (dotted) for the NH case while ?2 4 can be 
recovered from — \/t\ 3; similarly, for the IH case only t\ 4 (solid and dotted) are depicted while 
the major portions of ?2,3 lie outside of the displayed regions of t. The curves are discontinuous 
at a = Ik, jumping from one segment of a curve from below and at a = jK (indicated in the 
figure by a dot) to the other above the value (indicated by a cross). 

Keeping in mind the cancellation curves we now display some results on the radiative and 
leptonic decays. For definiteness, the octet masses are always chosen to be 

m = 10 TeV, m x = 400 GeV, m 2 = 200 GeV, (44) 

while the A parameter is chosen such that the strict bounds on /1 — > ey, 3e decays still leave 
some space in which tau decays are potentially accessible. We show in the upper panels of Fig. 
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5 the branching ratios for /I — > ey, 3e as a function of \t\ at three points of (05,argf) = (0,0) 
(solid), (tt/3, 0.107) (dashed), and (n/3, 0.485) (dotted) for the NH and tri-bimaximal mixing 
in case A. We have assumed A = 1.2 x 10~ 9 . Although the t parameter is an independent 
complex parameter, we have chosen its argument properly for each value of a so that \t\ in the 
interval [0, 1] contains one or two points saturating the cancellation condition. At R = 2 and 
a = 0, for instance, the cancellation occurs at t\ = 0.449, ti = 0.585 plus the other two outside 
the interval, while at a = n/3 it occurs at t\ = 0.212exp(0.485z), t 3 = 0.828 exp(0.107z) and 
two others. The current upper bounds on the decays |[T8l[T9l are also indicated. It is clear that 
the allowed ranges of\t\ depend significantly on both a and argL In the lower panels we show 
using the same parameters the branching ratios for x — ► efl, 3/1 that are closest to the current 
upper bounds EOl |22| . Although their variations in t, a are not as strong as designed for the 
muon decays, they are still significant. At (a,arg?) = (0,0) and (tt/3, 0.107) the branching 
ratio for x — > 3/i can approach the bound in the allowed ranges of \t\. The results for other tau 
decays and anomalous magnetic moments are about two or more orders of magnitude smaller 
than their current bounds and are less sensitive to the parameters. Fig. 6 displays similar curves 
for IH at A = 2.5 x 10~ 9 . The two curves in each panel correspond to (a, wcgt) = (0, 0) (solid) 
and (tt/3, —0.258) (dashed). The muon decays are significantly suppressed around |/| = 0.51 
and 0.61 respectively. Their sharper spikes can also be understood from the flatness of the t — R 
cancellation curves in Fig. 3. In the allowed ranges of parameters the decay X — ► 3/i is a few 
times smaller than its upper bound in the most favorable situation, while other decays are largely 
unobservable. 

The above results are presented for the simplified scenario of tri-bimaximal mixing. But 
global fittings of neutrino data generally prefer a slight deviation from it. We investigate now 
how rare decays could potentially be sensitive to the deviation. For definiteness, we fix 6\2 and 
023 to the central values obtained in Ref. Il34l . sin 2 0i2 = 0.32, sin 2 023 = 0.50, and vary the 
small angle $13 below its upper bound, sin 2 $13 < 0.05. As we pointed out earlier, for arbitrarily 
chosen values of the new parameters a, t and masses mo,i,2 5 all tau decays are generically too 
small to be observable when the bounds on rare muon decays are respected. Therefore, in the 
dominant portion of parameter space the decays cannot be sensitive to a small parameter like 
013. However, if the parameters happen to be located in the neighborhood of cancellation curves 
determined by eq (|37l ) and exemplified in Fig. HI the muon decays could be sensitive to $13. We 
show in Fig. |7]how their branching ratios vary as a function of 0i3 at A = 10~ 8 and for case 
B. We have set t = 0.449 (solid line) and 0.585 (dotted) for NH and t = 0.511 for IH. These 
values of t correspond to the points at which significant cancellation takes place in case A for 
the tri-bimaximal mixing. It is interesting that Br(/i — > 3e) in NH reaches its minimum not 
at 0i3 = but around 9\ 3 ~ 0.025. For such a 'large' value of A other decays are simply not 
observable. 
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Figure 5: Branching ratios as a function of \t\ in NH, tri-bimaximal mixing, and case A. 
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Figure 6: Branching ratios as a function of \t \ in IH, tri-bimaximal mixing, and case A. 
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Figure 7: Branching ratios in case B as a function of 0^ at sin 2 O12 = 0.32, sin 2 023 = 0.50, 8 = 
and a = 0. Upper panels for NH and lower ones for IH. The proposed limit to be reachable 
in Daya Bay experiment is also indicated. 



5 Conclusion 

A mechanism that generates tiny neutrino mass and large lepton mixing generically induces 
lepton flavor violating transitions in the charged lepton sector, if there is any observable effect at 
all of the mechanism at low energies. The transitions are extremely suppressed by tiny neutrino 
masses if they are induced only by standard gauge interactions. Their observability would 
thus necessitate the existence of new particles that could interact with neutrinos and charged 
leptons separately. A model of this sort has been devised recently IfTTTl . Its main merit is 
that the particles responsible for the interactions are colored, so that they could be copiously 
produced at hadron colliders. However, to make contact with the origin of neutrino mass it 
would be necessary to observe lepton signals produced from those colored particles. A realistic 
estimate of the signals should take into account the constraints that are already available. In this 
work we have made a complete analysis of the lepton flavor structure, provided a convenient 
parametrization to it, and studied systematically the radiative and pure leptonic transitions of 
the muon and tau leptons. We found that the current bounds on rare muon decays set a stringent 
constraint on rare tau decays that are generically far below the current experimental sensitivity 
for the majority of parameter space. However, there still exists the possibility that the new 
particles interfere destructively in the (ejl) sector such that the muon decays are significantly 
suppressed while their interactions with leptons are not necessarily reduced. This is indeed also 



16 



the region in parameter space relevant to collider physics. We have explored this possibility for 
rare tau decays and showed that the decays x — > /iy, 3ji are much enhanced compared to the 
general case. For the normal hierarchy of neutrino masses, the branching ratio for x — > 3/1 could 
reach the current level of precision while for the inverted hierarchy it is a few times smaller. 
Considering the rapid progress made in rare tau decays it is worthwhile pursuing further effects 
of this parameter region. 
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Appendix A: Phase space integrals 

We discuss and calculate some phase space integrals for the three-body decay £§(p) — > 
£a{k\)(.p(k2)iy(k-i). Its amplitude srf originates from box diagrams and also from radiative 
transitions when a pair of t and i is connected to the virtual photon, i.e., when a = y, or /3 = y, 
or a = /3 = y. For our purpose of estimating LFV branching ratios, it is a good approximation 
to treat the final state leptons as massless. But one must be careful with the terms related to 
radiative transitions when doing algebra in \s^\ 2 . Although the logarithmic mass singularity, 
ln(m|/m^), can be readily isolated, it is easy to miss some regular terms by setting masses (of 
leptons connected to the photon) to zero too early. 

The spin-summed and -averaged decay rate is 

r = -rA-^-PSalH^, (45) 

1 + 5 a p 2m§ ^ 



where 



PS 3 = f f J^L (2K) 4 g 4 (/7-fci-fc 2 -fc 3 )- (46) 

J {InflEi J (2n) 3 2E 2 J (2n) 3 2E 3 v ' KF iJ 

Using the kinematic symmetry in the final state, all required integrals can be converted to the 
following ones: 

(p2)(2A3) /(1A3) = PS 3 (p-*i,*23,*l-.P*23), 

^(1,2) x PQ {h-pMihi) 

*23 

p 2 K = PS3 ^, (47) 

s 23 

where k{j = kj ■ kj and S23 = (k2 + k 3 ) 2 . The integrals J\ 2, K appear only in radiative dipole 
transition terms, i.e., those proportional to 1 7^ 1 2 - Our convention here is that the virtual photon 
is connected to the leptons £p (k 2 ) and £7(^3) with /3 = y. 
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The basic integrals are, 
t2 



d 3 k 7 



d 3 k, 



(2n) 4 8 4 (Q-k 2 -k 3 ) 



{2n) 3 2E 2 J {2n) 3 2E 3 
d 3 k 7 r d 3 k 



with X(a,b,c) =a 2 + b 2 + c 2 — 2aZ? — 2&c — 2ra. To integrate over ki , we determine the interval 
of its magnitude to be given by 



1 m\ 
\k\\ = -xm s , xE [0,xo\, xq = 1 -4tj 2 , tj 2 = — r 
2 



(49) 



Note that it is safe to set mi = in computing the integrals J\ 2, K even for the process (3). This 
is because the singularities in s 2 3 and 531 do not overlap, as we pointed out in the main text. The 
final results are 



(4^) 3 /i 
(4^) 3 / 2 

(4^) 3 7i 
(4^) 3 7 2 
(4n) 3 K 



1 

12 
1 

24 
1 

96 
1 

4 

1 

48 



+0(772), 
3 , 1 

"2 +ln 4^ 



11 , 1 

ir+ ln i— 
6 4ti 2 



+ 0(772), 

+ C(T7 2 ), 



(50) 
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